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ABSTRACT 



An imaging device, such as an electric camera, in which an 
optical image of an object is converted into a set of image 
data. The device includes a line sensor and an area sensor. 
A lens system impinges the optical image onto the line and 
area sensors, where the first and second data are produced, 
respectively. At this time, a scanning mechanism moves (he 
line sensor relative to the optical image to scan the optical 
image. The first and second data is then synthesized into the 
image data to be output 
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IMAGING APPARATUS HAVING AREA Preferably, the first data includes a color information 

SENSOR AND LINE SENSOR while (he second data includes a brightness information. The 

HArirnRniTNm nvTmTKvmrurwt processing means produces the composite data by 

BACKGROUND OF THE INVENTION synthesizing the color information and the brightness inf or- 

1. Field of the Invention 5 mation together. 

The present invention relates to an apparatus and method Id another aspect of the invention, the first Image includes 

in which an optical image of an object is converted into a set * color information of a ROB color system while the second 

of image, data each corresponding to a picture element image includes a brightness information. In such case, the 

2. Description of the Prior Art image processing means determines a color of each picture 
- Atypical compact video-camera or electronic still-camera 10 d ™™* 8 components of high frequency of the color 
(digital camera) converts an optical image of an object into and bnghtness information. 

an image signal or image data using an area sensor, i.e M 111 a ^h** aspect of the invention, the line scanning 

two-dimensional image sensor. Although this area sensor is mechanism comprises a mirror and a drive motor for rotat- 

advantageous for ligfrt-weight and compact features, it has a iDg * e mirror * 

problem taproducing an outputimage of a high resolution. In a still further aspect of the invention, the line scanning 

For example, when such camera is used to take a picture of mechanism comprises a drive source for moving the line 

A-4 sized sheet including characters, the area sensor used sensor back and forth in a direction perpendicular to an 

therein is unable to provide images of characters which are optical axis of the optical image, 

eventually eligible to read. ^ The invention may includes an electronic viewfinder to 

To produce an image of high resolution, JPB 4-67836 20 wnidl ^ st imfl 8 e ^ " transmitted, 

discloses a line-scanning monochrome camera. In this The present invention further provides a method for 

camera, a line sensor, i.e., one-dimensional sensor is com- converting an optical image of an object into a set of image 

boned with a scanning mechanism such as a mirror rotating d*** each corresponding to a picture element, which method 

mechanism so that the object image can be scanned line by 25 ^rop 1 *^ receiving the optical image and converting them 

line to produce image data on the display. Although the mt0 a data using an area sensor, receiving the optical 

line-scanning camera may provide a high-resolution image, image and converting them into a second data using a line 

it requires the line sensor to mechanically and repeatedly sensor; and producing the image data from the first and 

scan over a two-dimensional optical image, which takes second data. 

more rime for picking up the whole image data of the object $q The first data may include a color information while the 

than the camera in which the area sensor is used. Also, even second data includes a brightness information. The image 

when taking a still image, the output image is prone to distort data is produced by synthesizing the color and brightness 

due to camera wobbling. information together. 

Further, the line sramiing camera reads the optical image Further, the step of producing the third image data may 

line by line, not simultaneously, and therefore it is disad- 35 comprises extracting data with respect to an outline of the 

vantageous in taking a tim* varying image. This hampers the object in the optical image from the first data, correcting the 

line sensor to be employed either in a high speed Imaging second data according to the extracted outline data and 

device or in an electric viewfinder for displaying the image. outputting the corrected second data as the image data. 

Furthermore, to produce a color image of high resolution BRIEF DESCRIPTION OF THE DRAWINGS 

with the use of the line sensor requires the object image to 40 *rw™ ~> * c ^ * ^ 

. . . . . .« v . . . ~ • These and other objects and features of the present 

be analyzed into three different colors, which increases the . .„ . „ y * *w c • a ^ 

number of the image data three times as many as the ^ention win become clear from me foHowing description 

™^rrl»hv ™ c wZ^^JZL^Z kLt! taken in conjunction with the preferred embodiments thereof 

XXZZ SlI reference to «» accompanying drawings throughout 

buffer having a large capacity, i.e., at least three Umes as that ^ uj^ parts are designated by like reference numerals, 

for monochrome image, in order to temporarily store the 45 andin whidr " WA *" <1WU umsitotoc uumatu* 

image totafOT a shading corrector „ , . " . . . , . . , . , 

correction. Still further, it takes much time for transniitting na 1 " a sdlcmaUc view of an electrical 

the image data and for processing the image data. cam ™ f, ^present invention; 

FIG. 2 is a block circuit diagram of the electrical camera; 

SUMMARY OF THE INVENTION ^ FIG. 3 is a block diagram showing a process of image 



It is therefore an object of the present invention to provide 

an improved imaging device and method which is capable of FIG. 4 is a schematic sectional view of an electrical 

taking a high-resolution picture of the object camera according to a second embodiment; 

To achieve the foregoing and other objects, and to over- FIG. 5 is a schematic sectional view of an electrical 

come the deficiencies of the prior art, the present invention 55 camera of third embodiment; 

provides an imaging apparatus for converting an optical FIG. 6 is a schematic sectional view of an electrical 

image of an object into a set of image data each correspond- camera according to a fourth embodiment; 

ing to a picture element, which comprises an area sensor far FIGS. 7(A) to (D) show rnodified processes for synthe- 

reoeiving the optical image and then converting the same sizing image data from the fine and area sensors; and 

into a first data, and a line sensor for receiving the optical 60 FIGS. 8(A) and (B) show arrangements of picture ele- 

image and men converting the same into a second data. A ments consisting of three different colors; red (R), green (G), 

lens system is used for focusing the optical image onto the ^4 5^ ^ 

area and Hne sensors. The line sensor is moved by a scanning 

mechanism to scan the optical image. The first and second DETAILED DESCRIPTION OF THE 

data are synthesized by image processing means to produce 65 PREFERRED EMBODIMENTS 

a composite data. This composite data is then output as the FIG. I shows a schematic wtimini view of an optical 

image data. system of an electronic camera 1 according to the present 
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invention. Camera L which is a portable color imaging for controlling an overall operation of camera 1. CPU 101 is 

device, comprises a housing 10. Housing 10 includes therein connected to a plurality of switches 61 to 63, a distance 

a line sensor 11, an area sensor 12, a line scanning mecha- measuring 51. a light measuring sensor 52, and a sensor 55 

nism 20, an optical lens system 30, and an electronic for sensing a ro t a t i ona l angle and rotational speed of scan 

viewfinder 40. 5 motor 22. Based upon signals from those switches and 

line sensor 11 includes a number of photoelectric detec- sensors, CPU 101 controls scan motor drive circuit 23, 

tars arrayed linearly, Le. , one-dimensionally. Conventional image control circuits 110 and 120, process control units 111 

monochrome type CCD (charge coupled device) or MOS and 121, analogue to digital (A/D) converters 112 and 122, 

(metal oxide semiconductor) are used for the photoelectric an image processing unit 130, an interface 145, and so on. 

detector. In this cmtodirnent, 2,000 photoelectric detectors 1Q Specifically, CPU 101 determines the rotational angle and 

are arranged in a line. rotational speed of scan motor 22, and then provides scan 

Area sensor 12 also includes a number of photoelectric motor drive circuit 23 with instructions so that the dichroic 

detectors arrayed in a lattice. Three different types of pho- mirror 21 can rotate at a redetermined speed to impinge the 

toelectric detectors are employed for detecting specific optical image onto line sensor 11. 

colors, i.e., red (R), green (G), and blue (B), respectively. The photoelectric detectors of line sensor 11 pick up an 

Conventional color type CCD or MOS is employed for the 15 optical image of the object in synchronism with each shift 

photoelectric detector. In this embodiment, approximately gate signal from image control circuit 110. Each image 

380,000 photoelectric detectors are used and are arranged in picked up by photoelectric detectors is then converted into 

the form of a matrix consisting of 768 columns and 494 an electric image data, which is then transmitted to process 

rows. Those detectors for R, G, and B are arranged in a unit 111 serially in the order that the photoelectric detectors 

specific pattern such as shown in FIGS. 8(A) or 8(B). 20 are arranged. Note that, in this embodiment, line sensor 11 

Note that the number of the detectors in the line sensor is is designed to read 3,000 lines for one optical image. On the 

greater than that of the detectors In each raw of the area other hand, the photoelectric detectors of area sensor 12 pick 

sensor. up the optical image of the object while line sensor 11 scans 

Further, line sensor 11 is electrically connected with an the overall image of the object Each photoelectric detector 

image control circuit lit while area sensor 12 is electrically of area sensor 12 converts the optical image into an electric 

connected with another image control circuit 120. image data. The image data is then delivered for each color 

Line scanning mechanism 20 includes a dichroic mirror to a process unit 121 in the order that the photoelectric 

21. Dichroic mirror 21 is drivingly connected to a scan detectors are arranged. 

motor 22 through a rotating shaft (not shown) which extends ^ The image data from line sensor 11 and area sensor 12 are 

parallel to a direction in which the photoelectric detectors of then processed through, for example, a shading correction at 

line sensor 11 are arrayed, Le., principal scanning direction. process units 111 and 121, respectively. After that, the image 

Scan motor 22 is electrically connected to a scan motor drive data are quantized at A/D converters 112 and 122, respec- 

orcuit 23 such that when scan motor drive circuit 23 outputs tively. The quantized image data, which corresponds to each 

a signal, scan motor 22 drives dichroic rmrror 21. Further, J5 of the photoelectric detectors, is then stored in memory 141 

line sensor 11, area sensor 12, and dichroic mirror 21 are so and 142. 

arranged that light reflected from dichroic mirror 21 Image process unit 13+ reads the electric image data 

impinges upon line sensor 11 while light transmitted through picked up by line sensor 11 and area sensor 12 from 

dichroic mirror 21 impinges upon area sensor 12, simulta- memories 141 and 142, and then synthesizes them in a 

neousty. Also, based upon a rotation of dichroic mirror 21, ^ certain form as will be described below. An image data DG 

the object is scanned in a direction perpendicular to the synthesized is transmitted through an interface 145 to an 

principal scanning direction, i.e., sub scanning direction. image memory (not shown) where it is stored therein as an 

Optical lens system 30 includes an objective lens 31 and object information. This object information is then fed to an 

an electrically driven focusing adjust mechanism 35, which image reproducing device such as a display or printer or an 

cooperate together to focus the optical image of the object on 4J image editing device such as a personal computer, if nec- 

photodectric detectors of both line sensor 11 and area sensor essary. 

12. FIG. 3 is a block diagram which shows a flow of the 

Viewfinder 40 includes a liquid crystal display (LCD) image processing. In this process, a photoelectric signal SI 

disposed on rear top of housing 10 and a LCD driving circuit produced by line sensor 11 is fed into a quantizing unit 131 

42. A shutter release button not shown is mounted on an 50 which in c lu des process unit 111 and A/D converter 112. 

upper surface of housing 10. Quantizing unit 131 applies the shading correction and a 

In operation of electronic camera 1 as constructed, the black-level adjustment to photoelectronic signal Sl» and 

optical image of fee object is transmitted along two optical then unit 131 quantizes photoelectric signal SI into image 

paths so mat same optical image can be impinged upon both data Dl consisting of a certain number of bit (for example, 

line sensor 11 and area sensor 12 at the same time, and 55 eight-bit), corresponding to each of 2,000 photoelectric 

therefore there is no parallax between images received by detector, sync hr onized with a clock not shown. Each image 

line sensor 11 and area sensor 12, respectively. Also, the data Dl represents a brightness Yl of Hght racked up by the 

optical image is scanned by rotation of dichroic mirror 21, photo-electric detector. 

and thus simplifies the construction of the optical mecha- Each image data Dl is processed at a correction process 

nism as compared with omer ordeal mechanism in which an 60 133 of image processing unit 150 to eliminate an image 

additional optical path is provided exclusively for the image distortion which is optically brought about as a result of line 

to be incident on the line sensor. Further, the line scanning scannmgandtoeffectanltermgtoirnprovette of the 

using such rotational mirror permits a high speed scanning image, through a pipeline image processing. Image data D10 

and provides a high precision for each distance between thus processed is then fed to a synthesizing unit 136 which 

lines. « wiU be described below. 

FID. 2 is a block diap^m of an decode system of camera Pbotc<lectionic signals S2 for each color from area sensor 

L System 100 includes a central processing unit (CPU) 101 12 are fed into a quantizing unit 132. Quantizing unit 132, 
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like quantizing writ 131, provides specific processes such as FIG. 6 also shows an electronic camera lc of the inven- 

a correction of offset between detectors with photoelectric bbn. This camera lc includes an optical lens system 30a of 

signals S2 and then converts each photoelectric signal S2 the twin-lens structure which is similar to mat of camera la 

into image data D2 consisting of a certain number of bit (far shown in FIG. 4 and a line scanning mechanism 20b of the 

example, eight-bit). Image data D2 represents a color of the 5 mirror system similar to that of camera lb in FIG. 5. 

object according to a RGB color system. Note that, because Although the description has been made for generating 

only 494 rAotoelectric detectors are arranged per line in area image data DG according to RGB color system in image 

sensor 12, the resolution of image data D2 is lower than that synthesizing unit shown in FIG. 3, the image data DG from 

of image data Dl from the line sensor. Image data D2 is then line sensor 11 and area sensor 12 may be synthesized in 

transmitted bom to a correction unit 134 and also to view- 10 different manners* 

***** 40 ' Specifically, as shown in FIG. 7(A), image data may be 

Correction unit 134 provides a correction of the image converted by XYZ color system, 

distortion and a filtering to image data D2. In addition, Also, as shown in FIG. 7(B), the darkness of each picture 

image data are so interpolated that the number of image data element of the resultant object image may be determined by 

are increased to 2,000 to make its resolution match with that i* an information of brilliancy Y2, in the CT£ uniform color 

of image data D10, i.e., 2,000. Hie increased number of space, obtained by area sensor 12 and a high frequency 

irnageoataD20isfedmtoam^ component Y1(H) of brightness obtained by area sensor 11. 

Matrix processing unit 135 generates an image data D21 The high frequency component mainly includes information 

which represents a color, Lc, hue and chromaticness, using indicating an outline or edge of a character or pattern which 

the psychometric chroma coordinates of CUE uniform color 20 can be obtained with a specific space frequency filter, 

space (CIEUV), based upon image data D20 of the RGB Further, as shown in FIG. 7(C), each color of the picture 

color system. element may be determined using both information of R, G, 

Next, in an image synthesizing unit 136, image data D21 or B . color generated by area sensor 12 and the high 

is synthesized with associated image data D10 (lightness ^ frequency component Y1(H) of brightness information from 

information) to produce image data DG serially, each of line sensor 11. Hie color information thus determined may 

which corresponds to a picture element in a display of the be stored in the form of information Y3 and UV which 

resultant object image. cooperate to represent a color difference. 

Note that image data D10 from line sensor U, which is a Furthermore, as shown in FIG. 7(D), image data DG of 

nigh-resolution image of an actual object, includes relatively ^ RGB color system may be generated by another process in 

great effectiveness of wobbling. Contrary to this, although which an imaging device having a filter for dividing a green 

each of image data D21 from area sensor 12 are picked up light is used for line sensor 11 while a separate area sensor 

simultaneously, it is the high-resolution pseudo data which 12a capable of reading only R(red) and £(blue) is used in 

has been obtained by the interpolation of the actual image place of area sensor 12. In such case, an image data of green 

data having a low resolution. Therefore, image data DG, 35 color generated from line sensor 11 is divided into a high 

which is obtained through the synthesizing of image data frequency component G(H) and a low frequency component 

D10 and D21, has a good quality but has a less effectiveness G(L), The image data is men synthesized with another image 

of wobbling. Meanwhile, a sensitivity of human eyes to data from area sensor 12a. 

color is lower man that to brightness, and therefore to In any one of einbodiments as described, electric view- 
reproduce an image using the composite image data DG has ^ finder uses image data D2 of area sensor 12, which enables 
no practical problem. electric cameras to be mrnpnrj and light-weighted rather 
FIGS. 4, 5, and 6 shows optical systems of electric than that of having the optical finder. Also, using the area 
cameras la to lc of other embodiments, in which same sensor provides image data D20 picked up at the same time, 
reference numerals represent the same elements, respec- Therefore, additional advantages can be provided for the 
tivefy. Electronic camera la in FIG. 4 includes an optical 45 imaging device by using image data D20 in a variety of 
lens system 30a of twin-lens reflex structure, in which two image processes such as process for correcting the distortion 
optical paths are provided for line sensor 11 and area sensor derived from the line scanning by means of extracting 
12, respectively. The object image is focused on area sensor outlines of the object, process for efficiently compressing the 
12 through lens 32 while the same impinges upon line sensor image through a recognition of a configuration and area 
11 through lens 31 and then mirror 21a of line scanning 50 determination, or a process for preventing flicker fringes 
mechanism 20a. Focus adjustment is carried out by an based upon a variation of the amount of light from the light 
electrical focusing mechanism 35a. With this twin-lens source. 

reflex structure, the intensity of the incident fight which As described above, the present invention provides the 

impinges on sensors 11 and 12 can be increased as compared imaging device with line sensor capable of reading and 

with a single lens reflex structure in which a light of the 53 converting the object image into single color data and area 

object is guided into two paths; one leading to fine sensor U sensor capable of reading and converting file image into a 

and the other leading to area sensor 12. plurality of color data, which enables the device to take a 

FIG. 5 illustrates an electronic camera 16 of the single picture with a high resolution. This permits the imaging 

lens reflex stracture.'niis camera lb includes a Hne scanning device to use an image buffer having a small capacity, 

mechanism 20b tor reciprocating line sensor 11 in a direc- 60 Further, the image processing in which data is transmitted 

tion perpendicular to an optical axis. No distortion in the place to another is carried out in a short time, 

optical image is generated because the line scanning is Therefore, the present invention make use of a advanta- 

carried out through a movement of the line sensor 11 in the geous combination of the line and area sensors, which 

direction perpendicular to the optical axis. Therefore, this enables the imaging device to take a high-resolution picture 

system i6 more advantageous than the rrdrror rotating system 63 of the object without any defect such as distortion, 

in which a length of optical path from the mirror to the While the invention has been described with reference to 

sensor changes according to the rotation of the rnir ro x. exemplary ^/mWvifm^rtt it is not limited thereto. Rather, the 
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appended claims should be construed to include other vari- 
ants and embodiments of the invention which may be made 
by those skilled in the art without departing from the true 
spirit and scope of the present invention. 
What is claimed is: 5 

1. An frwagifig apparatus for converting an optical image 
of an object into a set of image data each corresponding to 
a picture element, comprising: 

an area sensor far receiving (he optical image and then 
converting the same into a first data; . 10 

a line sensor for receiving the optical image and then 
converting the same into a second data; 

a lens system for focusing the optical image onto the area 
and line sensors; w 

a scanning mechanism for moving the line sensor relative 
to the optical image to scan the optical image; and 

image processing means for synthesizing the first and 
second data to produce a composite data and then 
outputting the composite data as the image data. 20 

2. An imaging apparatus as recited in claim 1, wherein the 
first data includes color information while the second data 
includes brightness information, and therein the image pro- 
cessing means produces the composite data by synthesizing 
the color information and the brightness information. 25 

3. An imaging apparatus as recited in claim 1, wherein the 
first data includes a color information of a RGB color system 
while the second data includes a brightness information, the 
image processing means determines a color of each picture 
element using components of high frequency of the color 30 
and brightness information. 

4. An imaging apparatus as recited in claim 1, wherein the 
scanning mechanism comprises a mirror and a motor for 
rotating the mirror. 

5. An imaging apparatus as recited in claim 1, wherein the 35 
scanning mechanism comprises a drive source for moving 
the line sensor back and forth in a direction perpendicular to 

an optical axis of the optical image. 

6. An apparatus as recited in claim 1, further includes an 
electronic viewfinder to which the first data is transmitted. 40 

7. A method far converting an optical image of an object 
into a set of image data each corresponding to a picture 
dement, comprising steps of: 

receiving the optical image and converting the same into 
a first data using an area sensor; 43 

receiving the optical image and converting the same into 
a second data using a line sensor, and 

producing the image data from the first and second data. 

& A method as recited in claim 7, wherein the first data 
includes color information while the second data includes 
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brightness information, and therein the image data is pro- 
duced by synthesizing the color and brightness information. 

9. A method as recited in claim 7, wherein the step of 
producing the image data further comprises: 

extracting data with respect to an outline of the object in 

the optical image from the first data; 
correcting the second data according to the extracted data; 

and 

outputting the corrected second data as the image data. 

10. A method as recited in claim 7, wherein the image data 
is produced by synthesizing the first and second data in said 
producing step. 

1L An imaging apparatus for converting an optical image 
of an object into a set of image data each corresponding to 
a picture element, comprising: 

an area sensor, 

a line senor; 

a lens system which focuses the optical image onto the 

area sensor and the Hne sensor; 
a scanning mechanism which moves the line sensor 

relative to the optical image to scan the optical image; 

and 

an image processor which produces the image data from 
a first data output from the area sensor and a second 
data output from the line sensor. 

12. An imaging apparatus as recited in claim 11, wherein 
said image processor synthesizes the first data and the 
second data to produce a composite data as the image data. 

13. An imaging apparatus as recited in claim 12, wherein 
the first data includes a color information of a RGB color 
system while the second data includes a brightness 
information, the image processor determines a color of each 
picture element using the color information and the bright- 
ness information. 

14. An imaging apparatus as recited in claim 11, wherein 
said lens system includes a first lens unit which focuses the 
optical image onto the area sensor and a second lens unit 
which focuses the optical image onto the Hne sensor. 

15. An imaging apparatus as recited in claim 1, wherein 
the image data is useful for reproducing the optical image of 
the object 

16. A method as recited in claim 7, wherein the image data 
is useful for reproducing the optical image of the object 

17. An imaging apparatus as recited in claim 11. wherein 
the image data is useful for reproducing the optical image of 
the object 

***** 
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